Papers with logit-based probe
Confidence Estimation for LLMs in Multi-turn Interactions (2026.findings-acl)
Copied to clipboard
Caiqi Zhang, Ruihan Yang, Xiaochen Zhu, Chengzu Li, Tiancheng Hu, Yijiang River Dong, Deqing Yang, Nigel Collier
| Challenge: | Despite recent progress, most prior work studies confidence in single-turn question answering. |
| Approach: | They propose a logit-based probe that measures confidence in multi-turn dialogues . they propose 'infoECE' and a "hinter-guesser" paradigm for generating controlled evaluations based on data . |
| Outcome: | The proposed framework is grounded in calibration and monotonicity of confidence as more information becomes available. |